Crossole: A Gestural Interface for Composition, Improvisation and Performance using Kinect
نویسندگان
چکیده
Meaning crossword of sound, Crossole is a musical metainstrument where the music is visualized as a set of virtual blocks that resemble a crossword puzzle. In Crossole, the chord progressions are visually presented as a set of virtual blocks. With the aid of the Kinect sensing technology, a performer controls music by manipulating the crossword blocks using hand movements. The performer can build chords in the high level, traverse over the blocks, step into the low level to control the chord arpeggiations note by note, loop a chord progression or map gestures to various processing algorithms to enhance the timbral scenery.
منابع مشابه
KIB: Simplifying Gestural Instrument Creation Using Widgets
The Microsoft Kinect is a popular and versatile input device for musical interfaces. However, using the Kinect for such interfaces requires not only significant programming experience, but also the use of complex geometry or machine learning techniques to translate joint positions into higher level gestures. We created the Kinect Instrument Builder (KIB) to address these difficulties by structu...
متن کاملGestural Musical Improvisation and Programming
We present a human-centered gestural system for musical improvisation, MIND. We demonstrate the relationship between music composition and programming. Preliminary field data from contextual inquiries in an elderly care setting suggest that the MIND system would be accessible to this population. A benefit of the system is the multimodal interaction technique through the invisible interface.
متن کاملGesture Profile for Web Services: An Event-Driven Architecture to Support Gestural Interfaces for Smart Environments
Gestural interfaces have lately become extremely popular due to the introduction on the market of low-cost acquisition devices such as iPhone, Wii, and Kinect. Such devices allow practitioners to design, experiment, and evaluate novel interfaces and interactions for new smart environments. However, gesture recognition algorithms are currently the appanage of machine learning experts which somet...
متن کاملA Markerless Gestural Interface for Avatar Control
This project serves as a gestural interface for searching a motion capture database. This system is intended to handle the gestures of a wide range of users employing algorithms that were trained on gestures identified in a user study. With this system, users can act out gestures in front of a natural interaction device, which will trigger different behaviors of an on-screen character. This ine...
متن کاملDeveloping a Gesture Based Remote Human-Robot Interaction System Using Kinect
Gesture based natural human-robot interface is an important function of robot teleoperation system. Such interface not only enables users to manipulate a remote robot by demonstration, but also ensures user-friendly interaction and software reusability in developing a networked robot system. In this paper, an application of gesture-based remote human-robot interaction is proposed using a Kinect...
متن کامل